Monitoring system

ABSTRACT

In a monitoring system, a master device stores setting information indicating a detection area of a target detected by a sensor in a storage unit, and transmits the setting information to a camera (a baby monitoring camera) having a sensor built thereinto or correlated with a sensor so as to set a detection parameter including the detection area therein. When a predetermined state set by the detection parameter is detected inside the detection area by the camera, a master device transmits detection notification information to a smartphone, and the smartphone displays a detection information screen based on the detection notification information transmitted from the master device on a display/input unit.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a monitoring system which performs datainput and output between a mobile phone terminal and a camera.

2. Description of the Related Art

In the related art, as an example of a monitoring system in which datainput and output are performed between a mobile phone terminal and acamera, there is a monitoring camera system which easily performs remotemonitoring even from a remote location and monitors a monitoring targetby using bidirectional communication of video and sound (for example,refer to Japanese Patent Unexamined Publication No. 2007-323533)

The monitoring system disclosed in Japanese Patent UnexaminedPublication No. 2007-323533 includes a controller which is a monitoringserver installed at an indoor distribution board in a predeterminedhouse lot (within a house), a first camera unit which is an interphonemaster device installed at an entrance door, a second camera unit whichis installed in a dining room, a third camera unit which is installed ina bedroom, an indoor unit which is an interphone master device installedin a living room, and one or more mobile phones present at remoteplaces. For example, in a case where a dweller is out, when each cameraunit detects an intruder, the controller switches and transmits acaptured video signal and a collected audio signal to the mobile phoneso as to capture the intruder.

SUMMARY OF THE INVENTION

However, in the above-described configuration disclosed in JapanesePatent Unexamined Publication No. 2007-323533, since a video signal andan audio signal from each camera unit are appropriately switched andtransmitted to the mobile phone so as to capture motions and sound ofthe intruder, a configuration of the controller is complex, and thisinevitably leads to an increase in cost, and it is difficult toimplement a monitoring system including the controller at low cost.

In order to solve the above-described problems, an object of the presentinvention is to provide a monitoring system which realizes data inputand output between a mobile phone terminal and a camera without damaginguser's convenience by using an existing fixed telephone which isconnected to a fixed telephone network and can perform calls to otherfixed telephones.

According to the present invention, there is a provided a monitoringsystem including a sensor; a camera that includes an image capturingunit, is provided in correlation with the sensor, and has a callfunction; a master device that communicates with the camera, and isconnected to a fixed telephone network so as to perform calls to otherfixed telephones; and a mobile phone terminal that includes adisplay/input unit, performs wireless communication with the masterdevice by using a wireless router, and is connected to other mobilephones via a mobile phone network, in which the master device storessetting information indicating a detection area of a target detected bythe sensor in a storage unit, and transmits the setting information tothe sensor so as to set a detection parameter including the detectionarea therein, in which, when a predetermined state set by the detectionparameter is detected inside the detection area by the sensor, themaster device transmits detection notification information to the mobilephone terminal, and in which the mobile phone terminal displays adetection information screen based on the detection notificationinformation transmitted from the master device on the display/inputunit.

According to the present invention, it is possible to realize data inputand output between a mobile phone terminal and a camera without damaginguser's convenience by using an existing fixed telephone which isconnected to a fixed telephone network and can perform calls to otherfixed telephones.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an example of a system configuration ofa monitoring camera system of the present embodiment;

FIG. 2 is a block diagram illustrating an example of an internalconfiguration of a master device;

FIG. 3 is a block diagram illustrating an example of an internalconfiguration of a cordless slave device;

FIG. 4 is a block diagram illustrating an example of an internalconfiguration of a camera;

FIG. 5 is a block diagram illustrating an example of an internalconfiguration of a sensor;

FIG. 6 is a block diagram illustrating an example of an internalconfiguration of a smartphone;

FIG. 7 is a diagram illustrating an example of a detection informationscreen displayed on a display/operation unit of the smartphone;

FIG. 8A is a diagram illustrating an example of a sub-menu screendisplayed on a monitoring screen;

FIG. 8B is a diagram illustrating an example of a detection settingscreen on the monitoring screen;

FIG. 8C is a diagram illustrating an example of a detection area settingscreen on the monitoring screen;

FIG. 9A is a diagram illustrating an example of a detection informationscreen displayed on a display/operation unit of the smartphone;

FIG. 9B is a diagram illustrating an example of a monitoring screen ofthe home security application;

FIG. 10 is a sequence diagram illustrating a first example of anoperation procedure of the monitoring camera system; and

FIG. 11 is a sequence diagram illustrating a second example of anoperation procedure of the monitoring camera system.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

With reference to the drawings, a description will be made of anembodiment (hereinafter, referred to as “the present embodiment”) of amonitoring camera system related to the present invention. In thefollowing present embodiment, as an example of a monitoring camerasystem related to the present invention, an exemplary monitoring camerasystem used for home security will be described. The present inventionis not limited to a monitoring camera system, and may be represented aseach of devices constituting the monitoring camera system, a method foreach device, and a program.

A monitoring camera system of the present embodiment includes a sensor;a camera that includes an image capturing unit, is provided incorrelation with the sensor, and has a call function; a master devicethat communicates with the camera, and is connected to a fixed telephonenetwork so as to perform calls to other fixed telephones; and a mobilephone terminal that includes a display/input unit, performs wirelesscommunication with the master device by using a wireless router, and isconnected to other mobile phones via a mobile phone network, in whichthe master device stores setting information indicating a detection areaof a target detected by the sensor in a storage unit, and transmits thesetting information to the sensor so as to set a detection parameterincluding the detection area therein, in which, when a predeterminedstate set by the detection parameter is detected inside the detectionarea by the sensor, the master device transmits detection notificationinformation to the mobile phone terminal, and in which the mobile phoneterminal displays a detection information screen based on the detectionnotification information transmitted from the master device on thedisplay/input unit.

FIG. 1 is a diagram illustrating an example of a system configuration ofmonitoring camera system 5 of the present embodiment. Monitoring camerasystem 5 is mainly provided in house 8, and includes master device 10,two cordless slave devices 20A and 20B (hereinafter, simply referred toas “slave devices”), a plurality of cameras (specifically, indoor camera30A, monitoring camera 30B, baby monitoring camera 30C, . . . ), varioussensors (specifically, human sensors 40A and 40B, smoke sensor 40C, andopening/closing sensor 40D), smartphone 50, and wireless router 60. Aconfiguration of monitoring camera system 5 is only an example and maybe modified in various aspects.

Master device 10 functions as a gateway in monitoring camera system 5.Master device 10 is a control device which controls the entire operationof monitoring camera system 5, and is connected to the slave devices,the cameras, the sensors, and the like in a communicable manner by usinga communication method such as digital enhanced cordlesstelecommunications (DECT). Master device 10 is connected to the Internet65 (network) via wireless router 60 using a wireless LAN. Master device10 is connected to fixed telephone network 85 in a wired manner and canperform a call to fixed telephone 80. Master device 10 has a function ofcharging slave device 20A which is inserted into an insertion port 10 a.

Slave devices 20A and 20B are connected to master device 10 in the DECTcommunication method and can perform a call to master device 10.Particularly, in a case where two slave devices 20A and 20B are notrequired to be differentiated from each other, the slave devices arecollectively referred to as slave device 20.

Various sensors 40 (specifically, human sensors 40A and 40B, smokesensor 40C, opening/closing sensor 40D, . . . ) are connected to masterdevice 10 in the DECT communication method. Herein, as sensors,opening/closing sensor 40D which detects opening and closing of awindow, smoke sensor 40C which detects smoke, and human sensors 40A and40B which detect a person with infrared rays are used. Particularly, ina case where the sensors are not required to be differentiated from eachother, the sensors are collectively referred to as sensor 40. As will bedescribed later, an infrared sensor 313 (refer to FIG. 4) built intocamera 30 is also used as a human sensor.

A plurality of cameras (specifically, indoor camera 30A, monitoringcamera 30B, baby monitoring camera 30C, . . . ) have a call function andare connected to master device 10 in the DECT communication method.Herein, as cameras, monitoring camera 30B which captures an image of anoutdoor environment, indoor camera 30A which captures an image of house8, and baby monitoring camera 30C which captures an image of a sleepinglocation of an infant (for example, a baby bed (not illustrated) or thevicinity thereof), are used. Particularly, in a case where the camerasare not required to be differentiated from each other, the cameras arecollectively referred to as camera 30.

Smartphone 50 is provided as an example of a mobile phone terminal.Smartphone 50 is connected to master device 10 via wireless router 60using a wireless LAN, and is connected to mobile phone 70 or othersmartphones via mobile phone network 75 using a communication methodsuch as the third generation (3G) method, a high speed package access(HSPA) method, or a long term evolution (LTE) method.

FIG. 2 is a block diagram illustrating an internal configuration ofmaster device 10. Master device 10 includes control unit 109, storageunit 103, an operation unit 105, and display unit 106. Master device 10receives various input operations and displays information such as animage on display unit 106. Control unit 109 has call control portion 110and an audio stream processing portion 112 built thereinto, and performscall control during calling, processing of audio data, and the like.

Master device 10 includes an image memory control unit 115 and an imagememory 116, and stores image data or the like captured by camera 30 inimage memory 116.

Master device 10 includes wireless LAN control unit 121 and wireless LANcommunication I/F unit 122, and transmits and receives image data andaudio data to and from smartphone 50, camera 30, and the like viawireless router 60 connected over a wireless LAN.

Master device 10 includes DECT protocol control unit 108 and DECTwireless I/F unit 107, and performs wireless connection to slave device20, sensor 40, and camera 30 by using a wireless method such as digitalenhanced cordless telecommunications (DECT).

Master device 10 includes audio bus 117, sound input/output control unit104, speaker 129, and microphone 128, and performs input and output ofsound to and from an external device.

Master device 10 includes fixed telephone line I/F unit 101, and canperform a call to external fixed telephone 80 connected to fixedtelephone network 85.

Master device 10 includes slave device/portable terminal charging unit126 and charges slave device 20 or smartphone 50 inserted into insertionport 10 a.

Master device 10 includes USB communication I/F unit 127, and transmitsand receives data to and from an apparatus, a memory, or the like havingan interface of a universal serial bus (USB) standard.

Master device 10 registers pairs of various sensors 40 and the pluralityof cameras 30 in storage unit 103 in correlation with each other. Forexample, human sensor 40B and monitoring camera 30B are installed atclose locations outdoors and are thus registered in correlation witheach other. Monitoring camera 30B, as will be described later,integrally has infrared sensor 313 (refer to FIG. 4) which is a humansensor and is built thereinto, and is thus also registered incorrelation with infrared sensor 313. Human sensor 40A, smoke sensor40C, and opening/closing sensor 40D are all installed inside house 8 andare thus registered in correlation with either indoor camera 30A or babymonitoring camera 30C. As baby monitoring camera 30C, a camera which hasa temperature sensor or the like built thereinto may be used, and, inthis case, the built-in sensor is registered in correlation with babymonitoring camera 30C.

FIG. 3 is a block diagram illustrating an internal configuration of(cordless) slave device 20. Slave device 20 includes control unit 247,storage unit 242, an operation unit 244, and display unit 245. Slavedevice 20 receives various input operations and displays informationsuch as an image on display unit 245.

Slave device 20 includes DECT protocol control unit 249 and DECTwireless I/F unit 248, and performs wireless connection to master device10, sensor 40, and camera 30 by using a wireless method such as DECT.

Slave device 20 includes audio bus 255, sound input/output control unit243, speaker 252, and microphone 251, and performs input and output ofsound to and from an external device.

Slave device 20 includes secondary battery 250 which is rechargeable,and, in a case of being used as a cordless slave device, each unit ofslave device 20 is supplied with power from secondary battery 250 so asto perform an operation.

FIG. 4 is a block diagram illustrating an example of an internalconfiguration of camera 30. Indoor camera 30A, monitoring camera 30B,and baby monitoring camera 30C as examples of cameras 30 havesubstantially the same configuration as each other. Camera 30 includescontrol unit 309, storage unit 303, and an operation unit 305. Camera 30performs an operation related to image capturing and also receives inputoperations.

Camera 30 includes DECT protocol control unit 317 and DECT wireless I/Funit 318, and performs wireless connection to master device 10 by usinga wireless method such as DECT.

Camera 30 includes wireless LAN control unit 321 and wireless LANcommunication I/F unit 322, and transmits and receives image data andaudio data to and from master device 10, smartphone 50, and the like viawireless router 60 connected over the wireless LAN.

Camera 30 includes audio bus 307, sound input/output control unit 304,speaker 329, and microphone 328, and performs input and output of soundto and from an external device.

Camera 30 includes an image capturing unit 312, an image memory controlunit 316, and an image memory 315, and stores image data captured byimage capturing unit 312 in image memory 315. Image capturing unit 312has a lens and an imaging element (for example, an image sensor such asa charged coupled device (CCD) or a complementary metal oxidesemiconductor (CMOS)).

Camera 30 integrally has infrared sensor 313 which is a passive infrared(PIR) sensor as a human sensor built thereinto. Infrared sensor 313detects the presence of a person by detecting a change in heat (infraredrays) generated by the person. However, infrared sensor 313 illustratedin FIG. 4 is not provided in baby monitoring camera 30C illustrated inFIG. 1. Camera 30 may have motion sensor 331 which detects a motion inan image captured by image capturing unit 312, temperature sensor 332which detects an ambient temperature, volume sensor 333 which detects avolume level of sound collected by microphone 328, and the like builtthereinto. Herein, it is assumed that motion sensor 331, temperaturesensor 332, and volume sensor 333 are built into baby monitoring camera30C. Camera 30 includes power source unit 314 which is constituted by acommercial AC power source, and each unit of camera 30 is supplied withpower from power source unit 314 so as to perform an operation.

FIG. 5 is a block diagram illustrating an example of an internalconfiguration of sensor 40. Sensor 40 includes control unit 447, storageunit 442, display lamp 445, and sensor unit 453. Sensor 40 performs apredetermined detection operation, such as turning on display lamp 445,in a case where a target (for example, an intruder which is also thesame for the following description) is detected by sensor unit 453.Sensor 40 includes DECT protocol control unit 449 and DECT wireless I/Funit 448, and performs wireless connection to master device 10 by usinga wireless method such as DECT, and sends sensor detection informationto master device 10 when a target is detected.

Sensor unit 453 differs depending on the kind of sensor 40. For example,in a case of human sensors 40A and 40B, sensor unit 453 is a PIR sensorwhich detects a person through a change in infrared rays. In a case ofopening/closing sensor 40D which detects opening and closing of a frontdoor, a window, or the like, sensor unit 453 is a reed switch whichswitches between turned-on and turned-off states due to opening andclosing. In a case of smoke sensor 40C, sensor unit 453 is a lightemitting/receiving unit which detects smoke when emitted light isblocked by the smoke. Sensor unit 453 may be a temperature sensor whichcan detect an ambient temperature.

Sensor 40 includes secondary battery 450 which is rechargeable, and eachunit of sensor 40 is supplied with power from secondary battery 450 soas to perform an operation.

FIG. 6 is a block diagram illustrating an example of an internalconfiguration of smartphone 50. Smartphone 50 as an example of a mobilephone terminal includes control unit 506, storage unit 504, anddisplay/operation unit (for example, touch panel) 503. Smartphone 50receives various input operations and displays information such as animage on display/operation unit 503. Control unit 506 includes aprocessor and realizes a predetermined function by the processorexecuting a predetermined program. Monitoring function control portion514 which can set various functions during an operation of monitoringcamera system 5, such as a function of camera 30, is built into controlunit 506.

As a program for realizing monitoring function control portion 514, anapplication for home security (hereinafter, referred to as a “homesecurity application”) is installed in smartphone 50 and is held instorage unit 504. Display/operation unit 503 constituted by a touchpanel or the like, which is a display/input unit in which a display unitand an operation unit are integrally formed, displays information suchas an image or an icon on a screen and receives a tap operation (or atouch operation) which is performed on the screen by a user ofsmartphone 50 (hereinafter, simply referred to as a “user”).

Smartphone 50 includes 3G protocol control unit 502 and 3G wireless I/Funit 501, and performs wireless connection to mobile phone 70 or othersmartphones connected to mobile phone network 75, by using a thirdgeneration (3G) wireless communication method. Smartphone 50 may includea protocol control unit and a wireless I/F unit corresponding to awireless communication method (for example, HSPA or LTE) other than the3G method.

Smartphone 50 includes audio bus 515, sound input/output control unit505, speaker 513, and microphone 512, and performs input and output ofsound to and from an external device.

Smartphone 50 includes wireless LAN control unit 507 and wireless LANcommunication I/F unit 508, and transmits and receives image data andaudio data to and from master device 10, camera 30, and the like viawireless router 60 connected over the wireless LAN.

Smartphone 50 includes USB communication I/F unit 511, and transmits andreceives data to and from an apparatus, a memory, or the like having aninterface of a universal serial bus (USB) standard. Smartphone 50includes secondary battery 550 which is rechargeable, and each unit ofsmartphone 50 is supplied with power from secondary battery 550 so as toperform an operation.

A description will be made of an operation of monitoring camera system 5having the above-described configuration.

First, descriptions will be made of an operation of smartphone 50,display of a screen and an input operation by using display/operationunit 503 during the operation. A description will be made of a casewhere the home security application installed in smartphone 50 isactivated by the user.

FIG. 7 is a diagram illustrating an example of an initial screen of thehome security application displayed on display/operation unit 503 ofsmartphone 50. In smartphone 50, when the home security application isactivated, an initial screen is displayed on display/operation unit 503.Menu FN indicating a plurality of respective functions executed by thehome security application is displayed on the initial screen. Aplurality of menu items including an icon and a function namecorresponding to each function are arranged and disposed in the menu FN.The menu items of menu FN includes camera FN1, a sensor, a power sourceplug, a phone, a smart control, and settings FN2.

If the user performs a tap operation on the icon of camera FN1 so as toperform an instruction operation, a monitoring screen which displays animage of a monitoring target captured by camera 30 is displayed ondisplay/operation unit 503. If the user performs a tap operation on theicon of settings FN2 so as to perform an instruction operation, asetting screen for performing various settings of the home securityapplication is displayed on display/operation unit 503. If the user tapsa sub-menu icon on a monitoring screen so as to perform an instructionoperation for calling sub-menu functions for performing various settingsand operations, a sub-menu screen including a pop-up screen or the likeof a box window is displayed on display/operation unit 503.

FIG. 8A is a diagram illustrating an example of a sub-menu screendisplayed on a monitoring screen of display/operation unit 503 ofsmartphone 50, FIG. 8B is a diagram illustrating an example of adetection setting screen, and FIG. 8C is a diagram illustrating anexample of a detection area setting screen. As illustrated in FIG. 8A,if the user performs an instruction operation of calling a sub-menufunction on the monitoring screen which displays image MV1 of amonitoring target captured by camera 30 (Baby monitoring camera1),sub-menu screen SB is displayed in a pop-up form. Sub-menu screen SBincludes, as menu items, camera speaker volume, indoor camera settingsSB1, alter log, and logout.

If the user performs a tap operation on the icon of indoor camerasettings SB1 so as to perform an instruction operation on the sub-menuscreen SB of FIG. 8A, a detection setting screen as illustrated in FIG.8B is displayed on display/operation unit 503. The detection settingscreen of FIG. 8B is a screen for performing setting of detectionperformed by a sensor or the like related to indoor camera 30A or babymonitoring camera 30C. Herein, a description will be made of an exampleof performing detection setting related to baby monitoring camera 30C.

A plurality of setting items corresponding to detection conditions ofvarious sensors 40 are arranged and disposed on the detection settingscreen of FIG. 8B. The setting items include motion detectionsensitivity (Motion Sensitivity) PA1, detection area selection (SelectDetection Area) PA2, detection brightness (Brightness) PA3, detectiontemperature (Temperature Alert) PA4, and detection volume (SoundDetection Alert) PA5.

Motion detection sensitivity PA1 is a parameter of motion detectionsensitivity in a case where a motion in an image captured by camera 30.Detection area selection PA2 is a parameter of a detection target areain which a motion is detected. Detection brightness PA3 is a parameterof a brightness level corresponding to a predetermined value in a caseof giving a warning when brightness around camera 30 exceeds thepredetermined value. Detection temperature PA4 is a parameter of anormal temperature range corresponding to a predetermined value in acase of giving a warning when a temperature around camera 30 exceeds thepredetermined value. Detection volume PA5 is a parameter of a volumelevel corresponding to a predetermined value in a case of giving awarning when volume of sound around collected by camera 30 exceeds thepredetermined value. In a case where such detection parameters are setby the user, and a predetermined state satisfying the detectioncondition occurs, the detection setting screen is displayed ondisplay/operation unit 503 of smartphone 50, and the user is notifiedthereof A warning is not limited to screen display using a detectionsetting screen or the like, and various notification means such assound, light, and vibration may be used.

If the user performs a tap operation on the icon of detection areaselection PA2 so as to perform an instruction operation on the detectionsetting screen of FIG. 8B, a detection area setting screen asillustrated in FIG. 8C is displayed on display/operation unit 503.Detection area image MV2 indicating a plurality of area sections dividedby matrix frames in a monitoring target image is displayed on thedetection area setting screen of FIG. 8C. If the user performs a tapoperation on a desired area section so as to perform an instructionoperation on detection area image MV2, the designated area is displayedhighlighted or gray for differentiation and is then is set asnon-detection area DE1. The illustrated example is an example in whichnon-detection area DE1 is designated and set, and detection is notperformed in non-detection area DE1.

For example, in a case of performing motion detection, a monitoringtarget child generally moves on a bed, and thus a central area is set asa non-detection area so that motion detection is not performed in babymonitoring camera 30C. In a case where baby monitoring camera 30Ccaptures an image of the entire baby bed, an area of the baby bedportion is set as a non-detection area, an outer portion of the baby bedis set as a detection area, and, when a motion is detected outside thebaby bed, a notification of the occurrence of an abnormality is sent.

By performing the icon of settings FN2 on the initial screen of FIG. 7,a setting screen having the same setting items as those of theabove-described detection setting screen may be displayed, and a settingoperation related to a detection operation of the camera or the sensormay be performed. Regarding setting of detection parameters, a pluralityof parameters may be collectively set on the detection setting screen ofFIG. 8B or a setting screen which shifts from the initial screen.Regarding setting of detection parameters, a parameter may beindividually set in each camera, or may be collectively set in aplurality of cameras. Regarding screen display, a sub-menu screen or asetting screen may be displayed through predetermined operation such asa menu selection operation, an icon indication operation, a gestureinput operation, and a shaking operation of shaking a casing ofsmartphone 50.

FIG. 9A is a diagram illustrating an example of a detection informationscreen displayed on display/operation unit 503 of smartphone 50, andFIG. 9B is a diagram illustrating an example of a monitoring screen ofthe home security application. If a state (here, a motion of amonitoring target in a captured image) corresponding to a predetermineddetection condition is detected by camera 30 or sensor 40 in a state inwhich smartphone 50 is in a standby state, when the home securityapplication is executed, or when other applications are executed, adetection information screen is displayed on display/operation unit 503of smartphone 50.

A detection notification AL indicating a location, content, and the likeof a target whose state corresponding to a predetermined detectioncondition is detected is displayed on the detection information screenillustrated in FIG. 9A. Detection notification AL of the illustratedexample indicates that a predetermined detection condition state (forexample, a motion in the image and the like) is detected in living room2 (Living 2) and an image of living room 2 is captured by babymonitoring camera 30C.

If the user performs a tap operation on the icon of detectionnotification AL so as to perform a monitoring display instructionoperation, the home security application is activated, and a monitoringscreen which displays moving image MV3 of a monitoring target capturedby camera 30 (baby monitoring camera 30C) at a location corresponding tothe detection information is displayed on display/operation unit 503 asillustrated in FIG. 9B. FIG. 9B is a diagram illustrating an example ofa monitoring screen which displays moving image MV3 of the monitoringtarget captured by baby monitoring camera 30C (Baby monitor camera1). Ifthe user performs a tap operation on an icon of monitoring stop IC5 soas to perform an instruction operation on the monitoring screen of FIG.9B, display of the monitoring screen is stopped, and the screen returnsto original screen display.

A description will be made of an operation of master device 10 relatedto the above-described operation of smartphone 50. In monitoring camerasystem 5, in a case where a display operation of a monitoring screen isperformed, master device 10 receives an instruction from smartphone 50and transmits display screen information of a monitoring screen whichwill be displayed on display/operation unit 503 to smartphone 50. Atthis time, master device 10 transmits an image data transmission request(image transmission request) to camera 30, and receives image datatransmitted from camera 30. Master device 10 transmits the image dataacquired from camera 30 to smartphone 50. If a state satisfying apredetermined detection condition is detected by camera 30 or sensor 40,master device 10 receives a detection notification from camera 30, andtransmits the detection notification to smartphone 50 so as to display adetection information screen on display/operation unit 503.

Next, a description will be made of a flow of an operation of monitoringcamera system 5. FIG. 10 is a sequence diagram illustrating a firstexample of an operation procedure of monitoring camera system 5. Herein,a description will be made of an operation in a case where a detectionarea for detecting a motion is set in baby monitoring camera 30C, and amotion is detected in a captured image. The first example is an examplein which a detection area and a non-detection area are determined incamera 30 (baby monitoring camera 30C).

If smartphone 50 receives an input operation of a detection area settinginstruction from the user through a touch operation or the like ondisplay/operation unit 503 of smartphone 50 (step S11), smartphone 50transmits a detection area setting image request to master device 10(step S12). If the setting image request is received from smartphone 50,master device 10 transmits an image data request of the area settingimage to baby monitoring camera 30C (step S13).

If the image data request is received from master device 10, babymonitoring camera 30C transmits image data of a still image of themonitoring target captured thereby to master device 10 (step S14).Master device 10 creates image information of a detection area settingscreen as a detection area setting image by using the image data of astill image acquired from baby monitoring camera 30C (step S15). Masterdevice 10 transmits the image data of a detection area setting screen tosmartphone 50 as the area setting image (step S16).

Smartphone 50 receives the area setting image transmitted from masterdevice 10 and displays a detection area setting screen ondisplay/operation unit 503. If smartphone 50 receives an input operationof setting a detection area from the user through a touch operation orthe like on display/operation unit 503 of smartphone 50 (step S17),smartphone 50 transmits an instruction for setting a detection area tomaster device 10 (step S18). At this time, the setting instructionincluding setting information (coordinates of the area, identificationnumber, and the like) of the detection area is transmitted. If theinstruction for setting the detection area is received from smartphone50, master device 10 preserves the setting information of the detectionarea in storage unit 103 (step S19), and sets a detection parameterincluding the detection area in baby monitoring camera 30C (step S20).At this time, also regarding other detection parameters for definingdetection conditions such as a threshold value of motion detection, asetting operation from the user is received from smartphone 50, andmaster device 10 preserves setting information of a detection parametertherein and sets a detection parameter in baby monitoring camera 30C.

For example, if baby monitoring camera 30C detects a motion which isequal to or higher than a predetermined level outside the detection areain an image of the monitoring target (step S21), the position where themotion is detected is located outside the detection area, and thus babymonitoring camera 30C does not send a notification of the motiondetection. For example, if baby monitoring camera 30C detects a motionwhich is equal to or higher than a predetermined level inside thedetection area in the image of the monitoring target (step S22), theposition where the motion is detected is located inside the detectionarea, and thus baby monitoring camera 30C sends a notification of themotion detection to master device 10 (step S23).

If the motion detection notification is received from baby monitoringcamera 30C, master device 10 creates image information of a detectioninformation screen as detection notification information of the motionin the detection area (step S24), and transmits the detectionnotification information to smartphone 50 (step S25). If the detectionnotification information of baby monitoring camera 30C is received frommaster device 10, smartphone 50 displays the detection informationscreen indicating the detection content on display/operation unit 503(step S26). If smartphone 50 receives an input operation of a monitoringdisplay instruction from the user through a touch operation or the likeon display/operation unit 503 of smartphone 50 in this state (step S27),smartphone 50 transmits an image data transmission request to masterdevice 10 (step S28).

If the image data transmission request is received from smartphone 50,master device 10 transmits the image data transmission request to babymonitoring camera 30C (step S29). If the image data transmission requestis received from master device 10, baby monitoring camera 30C transmitsimage data of the monitoring target captured thereby to master device 10(step S30). The image data includes at least one of video data of amoving image and image data of a still image. Master device 10 transmitsthe image data acquired from baby monitoring camera 30C to smartphone 50(step S31). Smartphone 50 receives the image data transmitted frommaster device 10 and displays a monitoring screen including a movingimage or a still image on display/operation unit 503 (step S32).

FIG. 11 is a sequence diagram illustrating a second example of anoperation procedure of monitoring camera system 5. The second example isan example in which a detection area and a non-detection area aredetermined in master device 10. Setting of a detection area is performedin the same manner as in the first example illustrated in FIG. 10 (stepsS11 to S20). In the second example, a detection area setting informationmay not be transmitted to baby monitoring camera 30C, and a detectionparameter of a detection area may not be set in baby monitoring camera30C.

If baby monitoring camera 30C detects a motion which is equal to orhigher than a predetermined level in an image of the monitoring target(step S21 a), baby monitoring camera 30C transmits information on aposition where the motion is detected and a motion detectionnotification to master device 10 (step S23). If the motion detectionnotification is received from baby monitoring camera 30C, master device10 determines whether or not the detection position is located insidethe detection area on the basis of the information on the position wherethe motion is detected. Here, if the detection position is locatedoutside the detection area, a notification of the motion detection isnot sent (step S24).

If baby monitoring camera 30C detects another motion in the image of themonitoring target (step S22 a), baby monitoring camera 30C transmitsinformation on a position where the motion is detected and a motiondetection notification to master device 10 in the same manner asdescribed above (step S23 a). If the motion detection notification isreceived from baby monitoring camera 30C, master device 10 determineswhether or not the detection position is located inside the detectionarea on the basis of the information on the position where the motion isdetected. Here, if the detection position is located inside thedetection area, image information of a detection information screen iscreated as motion detection notification information (step S24 b).Master device 10 transmits the detection notification information tosmartphone 50 (step S25). If the detection notification information ofbaby monitoring camera 30C is received from master device 10, smartphone50 displays the detection information screen indicating the detectioncontent on display/operation unit 503 (step S26). In the same manner asin the first example, if smartphone 50 receives an input operation of amonitoring display instruction from the user, master device 10 acquiresimage data from baby monitoring camera 30C and transmits the image datato smartphone 50, and smartphone 50 displays a monitoring screenincluding a moving image or a still image on display/operation unit 503(steps S27 to S32).

As mentioned above, monitoring camera system 5 of the present embodimentincludes sensor 40; camera 30 which includes image capturing unit 312,is provided in correlation with sensor 40, and has a call function;master device 10 which performs communication with camera 30 and isconnected to fixed telephone network 85 so as to perform calls toanother fixed telephone 80; and smartphone 50 which hasdisplay/operation unit 503, performs wireless communication with masterdevice 10 by using wireless router 60, and is connected to anothermobile phone 70 via mobile phone network 75.

Monitoring camera system 5 of the present embodiment can implement amonitoring system which is convenient to use at low cost by using acommunication function of an existing fixed telephone.

In monitoring camera system 5 of the present embodiment, master device10 stores setting information indicating a detection area of a targetdetected by sensor 40 in storage unit 103, and transmits the settinginformation to sensor 40 so as to set a detection parameter includingthe detection area therein; in a case where a predetermined state whichis set by the detection parameter is detected inside the detection areaby sensor 40, master device transmits detection notification informationto smartphone 50; and smartphone 50 displays a detection informationscreen based on the detection notification information transmitted frommaster device 10 on display/operation unit 503.

In monitoring camera system 5 of the present embodiment, if apredetermined state which is set by a detection parameter is detected,sensor 40 determines whether or not a detection position is locatedinside a detection area, and transmits a detection notification tomaster device 10 in a case where the detection position is locatedinside the detection area; and if the detection notification is receivedfrom sensor 40, master device 10 transmits detection notificationinformation to smartphone 50. Alternatively, if a predetermined statewhich is set by a detection parameter is detected, sensor 40 transmits adetection notification to master device 10; and if the detectionnotification is received from sensor 40, master device 10 determineswhether or not a detection position is located inside the detectionarea, and transmits detection notification information to smartphone 50in a case where the detection position is located inside the detectionarea.

In monitoring camera system 5 of the present embodiment, if a monitoringdisplay instruction is received from smartphone 50 in a state in whichthe detection information screen is displayed on display/operation unit503 of smartphone 50, master device 10 transmits an image transmissionrequest to camera 30 correlated with sensor 40; camera 30 transmitsimage data acquired by image capturing unit 312 to master device 10 inresponse to the image transmission request from master device 10; masterdevice 10 transmits the image data from camera 30 to smartphone 50; andsmartphone 50 displays a monitoring screen of the image transmitted frommaster device 10 on display/operation unit 503.

In monitoring camera system 5 of the present embodiment, master device10 transmits an image transmission request to camera 30; camera 30transmits image data acquired by image capturing unit 312 to masterdevice 10 in response to the image transmission request; master device10 generates a detection area setting screen by using the image dataacquired from camera 30 and transmits image data of the detection areasetting screen to smartphone 50; smartphone 50 displays the detectionarea setting screen transmitted from master device 10 ondisplay/operation unit 503; and master device 10 receives a detectionarea setting instruction for designating a detection area fromsmartphone 50.

As mentioned above, in a case where a detection operation such as motiondetection is performed by camera 30 or sensor 40, a detection area isset, and a notification of only a detection result in the detection areais sent. Therefore, it is possible to reduce an unnecessary detectionnotification sent to a user and thus to improve ease of use. Forexample, in a case where the present embodiment is applied to babymonitoring camera 30C, since an infant moves while sleeping, an area ofa baby bed portion is set as a non-detection area, and thus a motion ofthe infant such as turning over while sleeping can be caused not to bedetected. It is possible to give a warning to a user only incircumstances in which an abnormality notification is originallyrequired to be sent, such as an intruder into a house.

In a case where a motion or the like in a detection area is detected,smartphone 50 is notified of motion detection and displays detectioninformation, and thus it is possible to instantly easily understandcircumstances of a monitoring target even at a remote location. Sincesmartphone 50 is notified of detection information, and then an imagecaptured by camera 30 correlated with sensor 40 is transmitted tosmartphone 50 so as to be displayed, it is possible to instantlyunderstand the present circumstances of a monitoring target from whichan abnormality or the like is detected.

A detection area setting screen is displayed on smartphone 50 and adetection area is set and input, and thus a user can easily perform adetection area setting operation while viewing an image of a target.

Although the various embodiments have been described with reference tothe drawings, needless to say, the present invention is not limited tosuch embodiments. It is obvious that a person skilled in the art canconceive of various modifications or alterations within the scoperecited in the claims, and thus it is understood that they naturallyfall within the technical scope of the present invention. The respectiveconstituent elements in the embodiment may be arbitrarily combined witheach other within the scope without departing from the spirit of thepresent invention.

What is claimed is:
 1. A monitoring system comprising: a sensor, whichis not a camera; a camera associated with the sensor, the cameraincluding an imager and a communicator; and a master device that, inoperation, performs wireless communication with the communicator of thecamera according to a communication protocol, performs wirelesscommunication with one or more cordless handsets according to thecommunications protocol, and is connected to a fixed telephone networkto communicate with other fixed telephones, wherein the master deviceincludes a storage configured to store a non-detection area of thesensor wherein the non-detection area is based on an image, which iscaptured by the camera and divided into multiple selectable sections,and one or more of the multiple selectable sections are selected by auser to form the non-detection area that corresponds to a stationaryposition represented in the image; wherein the master device, inoperation, transmits the non-detection area to the sensor to set thenon-detection area in the sensor, the sensor, when detecting a definedstate within an area other than the non-detection area, transmits adetection notification to the master device, and the master device, whenreceiving the detection notification from the sensor, transmitsdetection notification information about the detection notification, viaa wireless router, to a smartphone that is connected to a mobile phonenetwork to communicate with other mobile telephones, for display on thesmartphone.
 2. The monitoring system of claim 1, wherein the sensor,when detecting the defined state, determines whether a detectionposition of the defined state is within the area other than thenon-detection area, and transmits the detection notification to themaster device when the detection position is within the area other thanthe non-detection area.
 3. The monitoring system of claim 1, wherein themaster device, after displaying the detection notification informationcorresponding to the sensor associated with the camera on thesmartphone, receives an image request for the camera inputted at andtransmitted from the smartphone, and forwards the image request to thecamera, the camera, in response to the image request received from themaster device, transmits an image captured by the imager to the masterdevice, and the master device transmits the image received from thecamera to the smartphone.
 4. The monitoring system of claim 1, whereinthe master device transmits an image request to the camera, the camera,in response to the image request received from the master device,transmits an image captured by the imager to the master device, and themaster device, based on the image received from the camera, generates anon-detection area setting screen in which the image is divided into themultiple selectable sections and transmits image data of thenon-detection area setting screen to the smartphone.
 5. The monitoringsystem of claim 1, wherein the sensor is an infrared sensor.
 6. Themonitoring system of claim 1, wherein the sensor is selected from agroup consisting of a human sensor, a smoke sensor, an opening/closingsensor, a temperature sensor, and a sound volume sensor.
 7. Themonitoring system of claim 1, wherein the communications protocols is aDECT (Digital Enhanced Cordless Telecommunications) protocol.
 8. Themonitoring system of claim 1, wherein the multiple selectable sectionsare displayed in a lattice-shaped frame.
 9. The monitoring system ofclaim 1, wherein the one or more of the multiple selectable sections areselected based on a user's tapping operation performed on the one ormore of the multiple selectable sections.
 10. The monitoring system ofclaim 1, wherein the one or more of the multiple selectable sectionsselected by the user are displayed in highlight.
 11. A monitoring methodbased on a monitoring system, the monitoring system comprising: (a) asensor, which is not a camera, (b) a camera associated with the sensor,the camera including an imager and a communicator, and (c) a masterdevice that, in operation, performs wireless communication with thecommunicator of the camera according to a communications protocol,performs wireless communication with one or more cordless handsetsaccording to the communications protocol, and is connected to a fixedtelephone network to communicate with other fixed telephones, themonitoring method comprising: storing, in the master device, anon-detection area of the sensor that is based on an image, which iscaptured by the camera and divided into multiple selectable sections,wherein one or more of the multiple selectable sections are selected bya user to form the non-detection area that corresponds to a stationaryposition represented in the image; transmitting, from the master device,the non-detection area to the sensor to set the non-detection area inthe sensor, detecting, at the sensor, a defined state within an areaother than the non-detection area, transmitting, from the sensor thathas detected the defined state, a detection notification to the masterdevice, receiving, at the master device, the detection notification fromthe sensor, and transmitting, from the master device that has receivedthe detection notification, detection notification information about thedetection notification, via a wireless router, to a smartphone that isconnected to a mobile phone network to communicate with other mobiletelephones, for display on the smartphone.
 12. The monitoring method ofclaim 11, further comprising: determining, at the sensor, whether adetection position of the defined state is within the area other thanthe non-detection area, and transmitting, from the sensor, the detectionnotification to the master device when the detection position is withinthe area other than the non-detection area.
 13. The monitoring method ofclaim 11, further comprising: receiving, at the master device that hasdisplayed the detection notification information corresponding to thesensor associated with the camera on the smartphone, an image requestfor the camera inputted at and transmitted from the smartphone,forwarding, from the master device, the image request to the camera,transmitting, from the camera that has received the image request fromthe master device, an image captured by the imager to the master device,and transmitting, from the master device, the image received from thecamera to the smartphone.
 14. The monitoring method of claim 11, furthercomprising: transmitting, from the master device, an image request tothe camera, transmitting, from the camera that has received the imagerequest from the master device, an image captured by the imager to themaster device, and generating, at the master device, a non-detectionarea setting screen in which the image received from the camera isdivided into the multiple selectable sections, and transmitting, fromthe master device, image data of the non-detection area setting screento the smartphone.
 15. The monitoring method of claim 11, wherein thesensor is an infrared sensor.
 16. The monitoring method of claim 11,wherein the sensor is selected from a group consisting of a humansensor, a smoke sensor, an opening/closing sensor, a temperature sensor,and a sound volume sensor.
 17. The monitoring method of claim 11,wherein the communications protocol is a DECT (Digital Enhanced CordlessTelecommunications) protocol.
 18. The monitoring method of claim 11,comprising: displaying the multiple selectable sections in alattice-shaped frame.
 19. The monitoring method of claim 11, comprising:selecting the one or more of the multiple selectable sections based on auser's tapping operation performed on the one or more of the multipleselectable sections.
 20. The monitoring method of claim 11, comprising:highlighting the one or more of the multiple selectable sectionsselected by the user.